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1.  Introduction 


Smart  weapons  technology  has  made  great  strides  in  recent  years,  leveraging  an  array  of  onboard 
sensors  to  deliver  real-time  guidance  and  navigation  capability  to  gun-launched  projectiles. 
However,  traditional  reliance  on  GPS  to  infer  relative  position  of  projectile  with  respect  to  target 
remains  a  significant  system  vulnerability  and  operational  constraint.  Taking  inspiration  from 
biological  systems  in  the  animal  world,  researchers  at  the  U.S.  Army  Research  Laboratory  have 
begun  to  develop  vision-based  navigation  (VBN)  for  precision  munitions.  This  technology  may 
one  day  provide  the  means  to  defeat  fast-moving  and  highly  maneuverable  targets  and  to  operate 
in  GPS-denied  environments.  Although  VBN  has  been  implemented  to  varying  degrees  onboard 
robots,  unmanned  aerial  vehicles,  and  even  missiles,  application  to  low-cost  gun-launched 
projectiles  will  require  the  development  of  tightly  coupled  vision  processing,  guidance,  and 
control  algorithms,  in  addition  to  a  highly  maneuverable  airframe  and  supporting  optics.  A 
crucial  part  of  this  effort  is  the  development  of  a  quantitative  description  of  the  physical 
constraints  that  bound  optimal  vision  performance. 

VBN  is  fundamentally  predicated  on  the  ability  to  observe  and  recognize  visual  cues  from  the 
surrounding  environment.  In  the  context  of  precision-guided  munitions,  these  cues  are  typically 
few  and  far  away.  Furthermore,  the  projectile  itself  is  hardly  an  ideal  viewing  platform.  Onboard 
optics  must  withstand  the  violence  of  gun  launch,  placing  severe  limitations  on  mechanical 
swivel  and  refocusing  systems.  Once  airborne,  a  forward-facing  imager  may  be  sky-stranded  for 
the  up  leg  of  ballistic  trajectories.  Once  the  target  comes  into  the  imager’s  field  of  view  (FOV), 
the  projectile  may  yet  be  kilometers  away.  At  this  distance  the  target  may  not  register  as  more 
than  a  few  blurred  pixels.  Cloud  cover,  haze,  aero-optical  effects,  atmospheric  turbulence,  and 
poor  lighting  can  further  obscure  the  target  and  complicate  the  task  of  image  capture  and 
recognition.  As  the  projectile  closes  the  intervening  distance,  the  target  continues  to  clarify.  But 
whether  effective  action  can  be  taken  will  depend  on  whether  image  capture  and  target 
recognition  can  be  achieved  while  sufficient  control  authority  yet  exists. 

The  window  of  opportunity  during  which  VBN  is  practically  relevant  is  constrained  by  several 
factors,  summarized  in  table  1. 

Table  1.  Constraints  of  vision-based  navigation. 


Situational  Contraints 

Device  Constraints 

Algorithmic  Constraints 

Projectile  trajectory  and  orientation 

Sensor  resolution 

Resolution  threshold  (i.e.,  pixels  on 
target) 

Slant  range 

Lens  characteristics  (e.g.,  FOV) 

Contrast  threshold 

Target  geometry  and  motion 

Processor  speed 

Computational  burden 

Atmospheric  conditions  (visibility, 
turbulence,  lighting)  and  aero-optical 
effects 

— 

— 

1 


These  constraints  naturally  suggest  three  distinct  milestones  along  the  flight  path,  depicted 
schematically  in  figure  1 : 

1.  Visual  acquisition  (V A) 

2.  Feature  recognition  (FR) 

3.  Point  of  last  maneuver  (PLM)  (beyond  which  control  authority  has  been  relinquished) 


Figure  1.  Three  critical  flight  stages  for  VBN:  visual  acquisition,  feature  recognition,  and  point  of  last  maneuver. 

These  critical  stages  provide  a  useful  framework  in  which  to  consider  the  performance  of 
potential  projectile  VBN  systems.  Our  goal,  then,  is  to  develop  a  set  of  models  that  describe  the 
effects  of  situational,  algorithmic,  and  device  constraints  on  visual  acquisition  and  feature 
recognition.  These  models  can  then  be  used  to  optimize  design  parameters,  evaluate 
performance,  and  expose  operational  limitations. 

This  report  will  focus  on  the  first  of  these  critical  points,  visual  acquisition.  Several  prototypical 
scenarios  will  be  modeled,  including  stationary  and  moving  target  engagements. 


2.  Projectile  Model 


Visual  acquisition  refers,  here,  to  the  trajectory  point  at  which  the  target  first  enters  the  camera’s 
FOV.  For  a  boresighted  imager,  the  wider  the  FOV,  the  earlier  visual  acquisition  can  occur. 
However,  maximizing  the  FOV  comes  at  the  expense  of  decreased  image  resolution  and,  hence, 
delayed  feature  recognition.  At  the  opposite  extreme,  minimizing  the  FOV  will  increase 


2 


resolution  (much  like  a  telescope).  This  approach  may  be  suitable  for  low  quadrant  elevation 
(QE)  or  flat-fire  applications.*  For  indirect  fire,  however,  this  could  delay  visual  acquisition  well 
past  the  point  of  last  maneuver.  Instead,  the  optimal  FOV  must  achieve  a  balance  of  sufficient 
resolution  and  early  visual  acquisition.  To  investigate  this  further,  we  first  need  a  quantitative 
model  of  ballistic  visual  acquisition  that  incorporates  realistic  flight  dynamics. 

To  simplify  the  mathematical  description,  we  adopt  the  following  assumptions: 

•  The  projectile-mounted  camera  is  forward  facing,  directed  along  the  projectile’s  axis  of 
symmetry. 

•  The  projectile  remains  oriented  along  the  instantaneous  velocity  vector,  v;  there  is  no 
pitching  or  yawing  motion. 

Referring  to  figure  2,  we  can  define  the  condition  of  visual  acquisition  as  the  instant  when 

(Ofov\  /n 

v  ■  s  =  vs  cos  r — —  1  (1) 

where  v  is  the  velocity  vector,  s  is  the  line-of-sight  vector  from  projectile  to  target,  and  dF0V  is 
the  optical  FOV.  The  optimal  0FOV  is  not  known  a  priori.  Still,  at  any  point  along  the  trajectory, 
there  will  be  a  particular  choice  of  0FOV  that  exactly  satisfies  the  visual  acquisition  condition: 

eFovthreshold  =  2  COS-1  [-^-]  (2) 


Figure  2.  Geometry  of  visual  acquisition. 

For  convenience,  we  define  a  target  angle,  a,  which  describes  the  angle  between  the  velocity  and 
line-of-sight  vectors. 

v  ■  s 

a  =  cos  1 -  (3) 

vs 


As  a  matter  of  practical  consideration,  a  very  narrow  FOV  could  invite  increased  image  jitter,  pixel  blur,  and  feature 
occlusion  due  to  platform  instability  or  other  periodic  motion. 
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(4) 


To  achieve  visual  acquisition  at  any  time,  t,  the  minimum  0FOV  is  then 

@FOV  =  2  cc\t\ 


Next,  we  must  define  a[t]  in  terms  of  QE,  initial  velocity,  atmospheric  conditions,  and  choice  of 
airframe. 


2.1  Equations  of  Motion 


To  model  flight  trajectories,  we  use  a  3 -degree-of- freedom  point-mass  model  governed  by  the 
following  set  of  coupled  nonlinear  ordinary  differential  equations  (Fresconi  et  al.,  2011): 


x  = 


y  = 


z  = 


TtpD^CxpV 

8  m 

TtpP^CxpV 

8m 

TipD^CxoV 

8m 


x 

y 

z  +  g 


(5) 


where  the  drag  coefficient  Cxo  is  generally  a  function  of  Mach  number,  M,  specific  to  the  choice 
of  projectile.  M  =  v/c.  p  and  c  (air  density  and  speed  of  sound,  respectively)  generally  vary 
with  altitude. 

2.2  Atmospheric  Model 

For  projectile  applications,  we  may  safely  assume  the  flight  path  is  constrained  within  the 
troposphere,  the  bottommost  portion  of  the  Earth’s  atmosphere,  extending  to  approximately 
1 1  km  above  sea  level.  In  this  region,  temperature  is  found  to  decrease  linearly  with  altitude  and 
can  be  empirically  characterized  by  a  constant  lapse  rate,  L  (in  kelvins  per  meter).  Following  the 
International  Standard  Atmosphere  model,*  we  adopt  the  following  assumptions: 

•  Hydrostatic  equilibrium 

•  Perfect  gas 

•  Gravitational  acceleration  constant  with  altitude 

•  Constant  temperature  lapse  rate 

Temperature  and  pressure  can  then  be  approximated  with  respect  to  ground  pressure  and 
temperature,  T0  and  p0,  (Portland  State  Aerospace  Society,  2004): 

T  =  T0  —  L  z  (6) 


* 

Formulated  by  the  International  Civil  Aviation  Organization. 
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(?) 


aji 

/  Lz\rl 

P  =  Po(1-^j 

where  p  is  ambient  pressure,  R  is  the  universal  gas  constant,  and  p  is  the  molar  mass  of  dry  air. 
Having  found  T  and  p,  we  invoke  the  ideal  gas  law  to  solve  for  the  air  density,  p: 


P  = 


P_P 

/?7 


PPo 


aji 
L  Z\RL 


{'-ft 


R(T0  -  Lz ) 


Finally,  the  speed  of  sound  is  given  by: 


where  y  is  the  adiabatic  index. 


c  = 


N 


N 


—  C 7*0 -LZ ) 

p 


(8) 


(9) 


2.3  Initial  Conditions 

From  figure  3,  we  can  immediately  write  down  the  initial  conditions  in  terms  of  the  zenith  and 
azimuth  angles  (equation  10): 


Z 


x[0] 

=  0 

x[0] 

=  v0 

sin[0o] 

cos[0o] 

y[o] 

=  0 

y[0] 

=  v0 

sin[0o] 

sin[0o] 

40] 

=  0 

m 

=  v0 

cos[0o] 

(10) 
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Note  that  0  =  0  (by  assumption),  so  we  may  choose  any  constant  0O  without  loss  of  generality. 
We  choose  0O  =  0  so  that  <p[t]  =  0.  The  projectile-specific  critical  parameters  are  now  m,  v0, 
D,  and  90.  Assuming  no  target  location  error  (TLE),  these  four  parameters  will  determine  the 
trajectory  and,  in  particular,  a[t]. 

As  an  example,  we  select  a  120-mm  mortar.  Tables  2  and  3  list  some  of  the  relevant  physical 
parameters. 


Table  2.  Example  120-mm  mortar  physical  data. 


Parameter 

Description 

Value 

Units 

(SI) 

D 

Diameter 

0.120 

m 

m 

Mass 

13.68490 

kg 

Table  3.  Atmospheric  data  and  physical  constants. 


Parameter 

Description 

Value 

Units 

Po 

Pressure  at  sea  level 

101325 

Pa 

To 

Temperature  at  sea  level 

288.15 

K 

L 

Temperature  lapse  rate 

0.0065 

K/m 

9 

Molar  mass  of  dry  air 

0.0289644 

kg/mol 

r 

Ratio  of  heat  capacities 

7/5 

— 

R 

Universal  gas  constant 

8.31447 

J/(K  mol) 

9 

Acceleration  due  to  gravity 
at  sea  level 

9.80665 

m/s2 

The  system  of  differential  equations  (5)  are  solved  numerically*  with  initial  conditions  (10)  for 
various  combinations  of  v0  and  00.  To  illustrate  the  response  of  a  with  respect  to  time  and  slant 
range,  we  choose  three  initial  velocities  and  three  QEs.  v0  values  were  100,  200,  and  300  m/s. 
QE  values  were  45°  (800  mil),  65°  (1156  mil),  and  85°  (1511  mil). 


This  coupled  set  of  nonlinear  ordinary  differential  equations  admits  no  analytic  closed-form  solution.  See,  for  example, 
Taylor  (2005,  p  62). 
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3.  Target  Model 


Perhaps  the  single  greatest  promise  of  VBN  is  the  potential  to  engage  moving  targets  whose 
relative  trajectory  is  not  absolutely  known  prior  to  firing.*  The  moving  target  scenario  can  take 
several  forms,  depending  on  the  uncertainty  of  target  location,  speed,  and  heading.  But  while  we 
could  speak  theoretically  about  Boolean  combinations  of  these  parameters,  any  bounded  target 
distribution  will  require  at  least  some  information  about  probable  location  and  speed.  In  this 
sense,  there  are  only  two  distinct  scenarios  that  we  can  investigate: 

1.  Probable  location  and  speed  (no  reported  heading  information). 

2.  Probable  location,  speed,  and  heading. 

To  be  sure,  the  source  of  the  information  (forward  observer  with  laser  range  finder,  plausible 
assumptions  about  mounted  or  unmounted  infantry  on  rough  terrain,  etc.)  is  critical,  as  the 
probability  density  function  describing  the  target  location  should  correspond  to  the  way  in  which 
the  information  was  gathered.  Still,  for  purposes  of  simulation,  these  differences  are 
distinguishable  only  in  the  underlying  probability  distributions  for  location,  speed,  and  heading. 
Our  approach,  then,  shall  be  to  investigate  these  two  representative  scenarios.  The  tool  developed 
here  should  be  adaptable  to  a  range  of  operational  situations  with  modification  of  the  underlying 
probability  distributions. 

3.1  Moving  Target  1  (No  Preferred  Heading) 

In  this  first  case,  the  initial  target  location  and  speed  are  known  with  some  measure  of  certainty, 
while  heading  is  entirely  unspecified.  Uncertainty  in  target  position  (like  all  measurements)  will 
generally  depend  on  the  particular  method  of  measurement  employed  by  the  observer  and  could 
result  in  higher  fidelity  along  one  orthogonal  axis.  For  now,  we  assume  a  symmetric  binormal 
distribution  with  the  mean  position  at  the  last  reported  target  location.  Heading  is  assigned  a 
uniform  distribution  (0°  to  360°),  while  speed  shall  be  defined  by  a  gamma  distribution^  with  a 
prescribed  mean  and  standard  deviation,  as  illustrated  in  figure  4.  The  target  begins  moving  at 
the  time  of  firing*  and  thereafter  maintains  constant  velocity.  We  are  primarily  interested  in  the 
earliest  instant  of  visual  acquisition,  before  corrective  action  has  been  taken.  Effects  of 
subsequent  course-correcting  maneuvers  are  therefore  not  considered. 


This  would  include  cases  of  not  only  unspecified  target  position,  but  also  of  uncertain  projectile  position — hence  the  very 
important  application  to  GPS-denied  environments. 

^Without  experimental  data,  the  decision  to  choose  one  distribution  over  another  is  more  a  matter  of  convenience  than 
physical  motivation.  The  gamma  distribution,  commonly  parameterized  by  a  and  /?,  can  be  assigned  an  exact  mean  and  standard 

Ll2  o2 

deviation  using  a  —  —  and  /?  =  — .  Also,  the  support  for  this  distribution,  x  E  (0,  oo),  correctly  excludes  nonphysical  “negative” 
speeds. 

■^This  implicitly  assumes  reported  information  is  still  fresh  at  the  time  of  firing.  If  this  is  not  the  case,  it  may  be  more 
appropriate  to  start  the  target  moving  at  some  prior  time,  yielding  a  proportional  increase  in  TLE. 


7 


r  distribution  with  jj=5  and  cr=2 


Figure  4.  Gamma  distribution  for  target  speed. 

The  error  parameters  used  in  this  simulation  are  summarized  in  table  4,  and  the  results  are 
collected  in  appendix  A  (section  A.2). 

Table  4.  Summary  of  error  parameters  (moving  target  1). 


Symbol 

Value 

Notes 

Mpos 

Om 

Mean  displacement  of  initial  target  location  from  reported  position, 
along  each  orthogonal  axis  in  the  XY  (ground)  plane 

Op  os 

10m 

Standard  deviation  of  target  position  along  each  coordinate  in  the  XY 
plane 

Mi ?el 

5  m/s 

Mean  target  speed 

Oyel 

2  m/s 

Standard  deviation  of  target  speed 

3.2  Moving  Target  2  (Preferred  Heading) 

We  now  consider  a  scenario  wherein  the  forward  observer  has  reported  not  only  speed  and 
position,  but  also  heading.  Again,  the  reported  information  is  necessarily  uncertain  because  of 
measurement  error.  Figure  5  shows  a  representative  trajectory  and  eventual  target  distribution  (at 
the  time  of  impact). 


8 


vO 

QE 

Trials 

PjXK 

Pvel 

^vel 

** 

150  m/s 

45.  deg 

5000 

0 

10  m 

5  m/s 

2  m/s 

55  : 

15® 

200 

150 

100 


*7  * 

"  — 

2000  2050  2100  2150  2200  2250 


x 


vO 

QE  TnaJs 

L50  m /s 

<15  deg  jCDD 

0  |  1  d  m 

5  m/s 

2  m/s 

35  * 

15s 

Figure  5.  Target  location  distribution  at  time  of  projectile  impact.  Red  arrow  is  drawn  from  reported  position 
at  time  zero  to  mean  target  position  at  impact. 

Error  levels  for  position  and  speed  are  unchanged,  but  we  have  introduced  additional  parameters 
for  the  mean  and  standard  deviation  of  the  target  heading,  as  shown  in  table  5. 

Table  5.  Summary  of  error  parameters  (moving  target  2). 


Symbol 

Value 

Notes 

Mpos 

0m 

Mean  displacement  of  initial  target  location  from  reported  position, 
along  each  orthogonal  axis  in  the  XY  (ground)  plane 

Op  os 

10m 

Standard  deviation  of  target  position  along  each  coordinate  in  the  XY 
plane 

H-vel 

5  m/s 

Mean  of  target  speed 

Oyel 

2  m/s 

Standard  deviation  of  target  speed 

0°,  45°,  90°,  135°, 
180° 

Mean  azimuthal  target  velocity  heading 

0(J) 

15° 

Standard  deviation  of  azimuthal  target  velocity  heading 

The  additional  heading  error  is  assumed  to  have  a  normal  distribution.  Technically,  modeling  a 
preferred  heading  with  the  unbounded  normal  distribution  will  allow  for  “wraparound”  effects, 
such  that  the  resulting  standard  deviation  of  the  angular  distribution  will  not  exactly  match  the 
specified  standard  deviation.  Practically,  the  contributions  from  the  tail  ends  are  completely 
negligible  for  any  reasonable  o^.  In  particular,  the  probability  of  a  wraparound  sample  point 

occurrence  would  be 


P(0  <  fi  —  7TV0>jU  +  7t) 


fi+n  ((b-fi)2 


(11) 
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Numerical  evaluation  shows  that,  for  the  assumed  15°  standard  deviation,  the  probability  of 
wraparound  is  effectively  zero  (figure  6).  This  is  not  surprising,  as  the  wraparound  point 
(i.e.,  ±180°)  is  12  standard  deviations  from  the  mean.* 


0.30 
0.25 
§  0.20 
4  0.15 
a  0.10 
0.05 
0.00 

0  30  *  60  D  90°  120 D  150  °  180  ° 

a 

Figure  6.  Probability  of  wraparound  as  the 
standard  deviation  of  <p  increases. 


Wrap-around  angle  probability 
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f 
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4.  Where  to  Aim 


Target  location  distribution  (as  a  function  of  time)  has  been  described  relative  to  reported 
position.  In  order  to  calculate  a,  we  must  also  fix  the  projectile’s  trajectory  in  relation  to  this 
point.  In  practical  terms,  the  question  is,  Where  should  one  aim  in  relation  to  the  reported  target 
position? 

4.1  No  Preferred  Heading 

Without  any  reported  heading  information,  it  may  seem  reasonable  to  shoot  for  the  last  known 
target  position.  However,  the  expanding  “doughnut”  distribution,  depicted  in  figure  7,  shows  that 
a  bull’s-eye  shot  would  almost  certainly  miss  the  target.  For  a  precisely  aimed  unguided  ballistic 
trajectory,  the  last  reported  position  of  a  moving  target  is  probably  a  poor  choice.1" 


* 

For  applications  with  a  much  greater  angular  standard  deviation,  this  wraparound  effect  could  be  avoided  by  judicious  choice 
of  an  alternative  bounded  distribution. 

^By  “precisely  aimed,”  we  mean  that  the  expected  miss  distance  (from  intended  impact  point)  is  much  less  than  the  expected 
target  displacement  from  the  reported  position.  Of  course,  if  the  lethal  effects  radius  is  large  enough  to  include  a  good  part  of  the 
target  distribution,  then  a  dead-center  miss  may  actually  have  the  greatest  kill  probability. 
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Figure  7.  Moving  target  distribution  evolving  in  time. 

In  the  context  of  guided  munitions,  however,  a  no-hit  initial  trajectory  may  be  acceptable  if  this 
choice  increases  the  probability  of  a  successful  follow-on  corrective  maneuver  and  ultimate 
target  intercept.  An  optimal  trajectory,  seeking  to  maximize  this  probability,  will  generally 
depend  on  the  control  authority  of  the  particular  vehicle  and  the  character  of  the  target  distribution. 
As  a  first-order  approximation,  we  shall  assume  control  authority  is  symmetric  about  the  point  of 
impact,  and  corrective  action  is  proportional  to  expected  miss  distance,  so  that  only  the  target 
distribution  need  be  considered.  It  seems  natural,  then,  to  place  the  ballistic  point  of  impact  at  the 
center  of  this  distribution.*  In  subsequent  targeting  scenarios,  it  will  be  necessary  to  define  this 
central  point  more  carefully.  For  now,  because  we  have  a  circular  distribution  with  no  preferred 
heading,  this  point  is  trivially  located  at  the  last  reported  target  location. 

4.2  Preferred  Heading 

As  in  the  previous  section,  we  must  address  the  question  of  where  to  fix  the  initial  ballistic 
impact  point  in  relation  to  the  reported  target  position.  Again,  we  select  the  center  of  the  target 
distribution,  pc.  However,  as  there  is  now  a  preferred  heading,  the  target  distribution  is  no  longer 


*  _  _ 

The  center  of  the  annulus  in  figure  7  is  clearly  coincident  with  the  centroid  ( x,y ).  It  is  not  immediately  apparent,  however, 
that  this  point  should  also  represent  the  spatial  median  (equation  12).  Perhaps  there  exists  some  other  point  (or  locus  of  points) 
that  better  minimizes  the  sum  of  distances.  Consider  the  following  figure: 


By  inspection,  any  point  on  segment  A±A2  is  a  spatial  median  of  points  {A1,A2}.  By  the  same  argument,  if  point  F  is  included  in 
all  line  segments  P\P2,  then  F  is  the  unique  spatial  median  of  all  points  Pt.  The  radial  symmetry  of  the  target  distribution  allows 
us  to  pair  off  all  points  about  the  center,  confirming  that  the  geometric  center  is  indeed  coincident  with  the  spatial  median. 
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symmetric  about  the  reported  position,  and  we  must  more  precisely  define  the  distribution  center. 
Notionally,  the  motivation  for  using  a  “center  point”  is  that,  on  average,  it’s  “closest”  to  all  other 
points  and  would  therefore  tend  to  capture  a  maximum  of  the  probability  density  distribution  (of 
target  location)  within  the  control  shadow  of  the  projectile.  In  this  sense,  what  we  need  to  find  is 
the  coordinate  from  which  the  sum  of  Euclidean  distances  to  all  other  distribution  points  is 
minimized,  the  so-called  spatial  median*  Specifically, 

n 

=  <12> 
i=l 

where  X  is  a  set  of  points  in  Mp,  and  Hsm{X )  is  the  spatial  median  of  the  set.  For  a  target 
constrained  to  the  XY  plane  (bivariate  case,  no  flight  capability,  hills,  or  valleys),  p  =  2. 

Historically,  the  analogous  problem  was  first  posed  by  Fermat  for  three  noncollinear  points  and 
exactly  solved  by  Torricelli  in  the  mid  17th  century  (Hale  and  Moberg,  2003).  The  more  general 
problem  of  n  points  in  two  or  more  dimensions  was  formulated  by  Weber  in  1909,  with 
reference  to  the  problem  of  optimal  facility  location  (Hale  and  Moberg,  2003),  but  no  closed- 
form  solution  exists,  and  algorithmic  approximations  are  computationally  intensive  (Bose  et  al., 
2003).  From  a  practical  standpoint,  the  use  of  the  spatial  median  to  calculate  and  update  the 
optimal  ballistic  impact  point  may  not  be  well  suited  for  real-time  applications,  t 

A  popular  alternative  distribution  center  is  given  by  the  centroid,  which  minimizes  the  sum  of 
squared  Euclidean  distances  between  itself  and  each  point  in  a  set.  While  the  centroid  is  the 
physically  correct  choice  for  many  applications,  it  is  not  generally  coincident  with  the  spatial 
median  and  would  therefore  serve  only  as  an  approximation  of  the  desired  central  tendency.  Still, 
the  centroid  can  be  calculated  in  linear  time  for  a  discrete  set  of  points  and  may,  as  in  this  case, 
admit  closed-form  solutions  if  the  probability  density  function  is  known.  In  the  present  scenario, 
the  target  motion  may  be  described  by  the  vector  equation: 


P target  P intial  T  V  t 


(13) 


Equivalently,  in  component  form,  we  have: 

Q=0( 3- 

where  v  is  the  scalar  target  velocity,  and  <p  is  the  (azimuthal)  target  heading. 


(14) 


* 

Also  referred  to  as  the  geometric  median  or  Fermat-Weber point. 

^Much  research  has  gone  into  speeding  up  approximation  algorithms  for  the  spatial  median  of  an  arbitrary  set  of  points.  See, 
for  example,  Bose  et  al.  (2003).  In  the  present  context,  however,  it  seems  reasonable  to  represent  the  central  target  location  in  the 
form  p central  =  P initial  +  Pth*  »  where  \iv  is  the  mean  (reported)  velocity,  and  a  is  a  constant,  which  depends  only  on  a $  and 
the  median  type  (e.g.,  centroid,  LI,  L2).  Indeed,  for  the  centroid  descriptor  we  shall  derive  a  closed  form  for  /^[a^].  For  other 
descriptors,  this  table  of  coefficients  could  be  compiled  numerically. 
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In  general,  for  two  independent  random  variables  { P ,  Q}  and  constants  {a,  b},  the  expectations 
will  follow  (Zwillinger,  2003): 

E[aP  +  bQ]  =  aE[P]  +  bE[Q]  (15) 

E[PQ]  =  E[P]E[Q ] 


Then  for  target  position  p target* we  have: 


[©H 

=  E 


(?;): 

(?;): 


+  E 


[(C0S*>1 

LVsind>/  1 


Now,  E  [(f)]  and  E[V]  correspond  to  the  reported  target  position  and  speed,  respectively. 

Finally,  E  [(^^)]  can  be  calculated  for  each  component.  By  construction,  d>  draws  from  a 
normal  distribution.  The  expectation  (mean)  along  each  dimension  is  then* 

00  Q-0)2 


(16) 


E(cos<P)  =  J  cos  (p 


e  2cr2 

*  — — — dtp 


yfliza 


(17) 


=  e  2  cosjU 

00  Q-<ft)2 

r  e  2<t2 

£,(sind>)  =  sin0* — -= — dcf) 

J  yJ2na 


(18) 


=  e  2  sin  jU 


The  centroid  of  the  target  distribution  is  composed  of  the  mean  along  each  dimension: 


P centroid  ~  Preported  "b 


e  2  cos 


P<P 


\ 


. 

e  2  sin 


t7 reported  t 


(19) 


An  alternative  central  location  can  be  defined  by  the  coordinate-wise  median  along  each 
dimension.  This  point  exactly  solves  the  Weber  problem  under  the  L\  (Manhattan)  metric  (Bose 
et  al.,  2003).  Given  the  inherent  symmetry  of  the  target  distribution  and  the  uniqueness  of  the 
n>  2  dimensional  spatial  median  (Milasevic  and  Ducharme,  1987),  the  spatial  median  must  lie 
along  the  axis  of  symmetry  (i.e.,  the  reported  target  heading  vector).  Furthermore,  as  the  2-D 
target  distribution  collapses  toward  the  axis  of  symmetry,  the  spatial  median  must  exactly 
approach  the  sample  median  along  the  1-D  downrange  axis.1'  These  observations  suggest  that  for 


❖ 

The  0  subscripts  are  suppressed  for  readability. 

^The  spatial  median  of  any  even  number  of  arbitrarily  placed  points  along  one  dimension  is  not  unique,  but  the  locus  of  points 
satisfying  this  condition  must  include  the  sample  median.  For  an  odd  number  of  points,  the  solution  is  unique  and  coincident  with 
the  median. 
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small  <70,  the  location  of  the  spatial  median  may  be  approximated  by  the  coordinate-wise 
median.  Indeed,  table  6  shows  that  for  small  a^,  the  coordinate- wise  median  almost  exactly 
overlays  the  spatial  median  and  appears  (even  for  larger  cr^)  to  consistently  provide  a  better  fit 
than  does  the  centroid. 

Table  6.  (Left)  Target  distributions  after  40  s  for  various  Arrow  is  directed  from  the  target’s  initial  position  at  t0 
to  the  spatial  median  after  40  s.  (Right)  Cumulative  distribution  functions  for  three  central  locations. 
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Table  6.  (Left)  Target  distributions  after  40  s  for  various  a Arrow  is  directed  from  the  target’s  initial  position  at  t0 
to  the  spatial  median  after  40  s.  (Right)  Cumulative  distribution  functions  for  three  central  locations 
(continued). 


Table  6  compares  the  cumulative  distribution  function  of  miss  distances  for  centroid,  coordinate- 
wise  median,  and  spatial  median.  Although  the  cumulative  distribution  function  is  sensitive  to 
<j(p,  the  particular  choice  for  central  estimate  does  not  appear  to  have  an  appreciable  effect  for 
small  <T0.  For  the  present  application,  the  spatial  median  provides  only  a  small  advantage  over 
the  other  approximations  just  described.  For  computational  convenience,  we  shall  therefore 
employ  the  centroid  formulation  (equation  19)  as  our  working  central  location  estimate. 

For  each  trajectory,  characterized  by  { v0 ,  QE},  we  would  like  to  investigate  visual  acquisition 
performance  as  a  function  of  reported  target  heading,  [i^.  From  equation  19  it  is  clear  that  the 
displacement  vector  p compact]  ~  Pclfo]  will  depend  on  n^.  In  order  to  ensure  that  p compact] 
remains  identical  across  all  headings,  we  must  appropriately  offset  the  reported  target  position.* 
From  a  modeling  standpoint,  this  is  accomplished  by  defining  prep  with  respect  to  the  eventual 
(fixed)  ballistic  impact  point. 

Prep  ~  P ballistic 


In  effect,  the  reported  position  must  vary 


qy 

e  2  cos 

<70  2 


I  Vrep  t  imp  act 


(20) 


e  2  sin/r^ 


so  that  all  targets  converge  on  the  same  point  (figure  8). 


* 

Another  way  to  maintain  experimental  uniformity  would  be  to  “report”  all  targets  at  the  same  initial  position  (with  variable 
headings)  and  then  have  them  propagate  toward  separate  ballistic  impact  points.  But  this  implies  changing  also  the  projectiles’ 
initial  conditions  {v0,  QE }  to  assure  an  intercept. 
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Figure  8.  To  ensure  that  all  targets  converge  on  the  same  ballistic  impact  point,  it  is  necessary  to 
offset  the  reported  target  position  for  each  reported  heading. 


It  should  be  emphasized,  therefore,  that  even  without  any  TLE,  the  relative  orientation  of 
projectile  and  target  (measured  in  terms  of  the  angle  a )  will  depend  on  target  heading.  In 
particular,  because  we  have  aligned  the  x  axis  along  the  downrange  axis,  a  target  heading  of 
=  0°  will  always  yield  the  largest  a  across  the  trajectory,  as  illustrated  in  figure  9.  Analogous 
results  for  all  selected  combinations  of  { v0 ,  QE,  are  included  in  appendix  A  (section  A.3.1). 


Figure  9.  Representative  results  for  Monte  Carlo  simulation  of  moving  target  2  (with  preferred  heading). 
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From  a  design  and  requirements  standpoint,  it  is  useful  to  capture  the  effects  of  TLE  in  the 
context  of  an  idealized  a  history.  Figure  10  shows  performance  by  percentile  as  well  as  the  no- 
TLE  estimates  for  a  representative  case.  Analogous  results  for  all  selected  combinations  of 
{v0,  QE,  n<p}  are  included  in  appendix  A  (section  A.3.2). 
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Figure  10.  Representative  results  for  Monte  Carlo  simulation  of 
moving  target  2:  middle  70th  percentile  bounds  on  a. 


5.  Simulation  Studies 


We  consider  a  matrix  of  nine  projectile  trajectories,  representing  combinations  of  three  possible 
QE  angles  and  three  initial  velocities.  Three  scenarios  are  simulated: 

•  Stationary  target  without  TLE 

•  Moving  target  without  preferred  heading  (with  and  without  TLE) 

•  Moving  target  with  preferred  heading  (with  and  without  TLE) 

In  all  cases,  projectile-state  is  assumed  to  be  error-free.  The  simulation  code  has  been  written  in 
Mathematica  and  is  easily  adapted  to  other  projectile  airframes,  initial  conditions,  and  target 
statistics. 

Plots  displaying  results  of  Monte  Carlo  simulations  are  found  in  appendix  A. 
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6.  Discussion 


The  application  of  VBN  to  projectile  navigation  is  a  novel  and  untested  proposition.  As  such,  it 
is  natural  to  wonder  at  this  early  stage  whether  optical  considerations  will  prove  to  be  a  minor 
engineering  detail  or  a  central  research  challenge.  On  its  own,  the  present  analysis  does  not  fully 
address  this  question.  Overall  performance  will  depend  not  only  on  visual  acquisition,  but  also 
on  target  recognition  (among  other  factors).  Still,  because  sight  must  logically  precede  detection, 
the  characterization  of  visual  acquisition  in  the  context  of  projectile  and  target  dynamics  places  a 
definite  and  predictable  limit  on  earliest  possible  detection.  In  the  presence  of  TLE,  especially 
for  a  fast-moving  target,  these  geometric  and  statistical  considerations  also  reveal  a  “latest 
possible  detection.” 

While  a  complete  discussion  of  the  physical  constraints  of  target  recognition  is  beyond  the  scope 
of  this  report,  it  is  instructive  to  consider  the  simple  case  of  a  diffraction-limited  pinhole  camera, 
neglecting  atmospheric  and  aero-optical  effects.  We  assume  a  resolution  threshold  of  32  x  32 
pixels  on-target  is  needed  for  recognition.*  The  idea  that  scene  recognition  is  directly  correlated 
with  pixels  (or  line  pairs)  on-target  seems  intuitive,  as  illustrated  in  figure  1 1 . 

12  x  12  22  x  22  32  x  32  52  x  52  120  x  120 


Figure  11.  Scene  recognition  is  correlated  with  pixel  resolution. 

Device  specifications  and  other  assumptions  are  listed  in  table  7.  The  resulting  minimal 
dimension  for  a  discernible  target  is  plotted  with  respect  to  slant  range  for  several  FOVs+ 
(figure  12). 


* 

This  threshold  was  found  empirically  for  human  scene  recognition  (Torralba,  2009).  Other  recognition  thresholds  can  be 
found  in  the  literature — most  notably,  the  Johnson  criteria  (Johnson,  1958),  which  requires  six  line  pairs  (or  12  pixels)  along  the 
minimum  target  dimension  for  a  50%  probability  of  recognition.  See  Kopeika  (1998)  for  a  more  complete  discussion.  The  actual 
resolution  threshold  for  machine  vision  will  depend  on  the  particular  vision  algorithms  used  and  should  be  measured 
experimentally  for  a  given  system.  However,  the  consensus  appears  to  be  that  machine  vision  will  not  outperform  human 
recognition  in  the  foreseeable  future.  Our  use  of  human  threshold  levels  should  therefore  be  viewed  as  a  best-possible  expectation 
for  machine  vision. 

derivation  of  this  resolution  model  is  included  in  appendix  B.  The  diffraction  limit  is  given  by  the  Rayleigh  resolution 
criterion:  two  point  sources  of  equal  intensity  can  just  be  resolved  with  diffraction-limited  optics  if  separated  by  a  view  angle  of 
sin-1  (1.22  A/D),  where  A  is  the  wavelength,  and  D  is  the  aperture  diameter  (Woan,  2003). 
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Table  7.  Example  imager  specifications  and  assumptions. 


Imager  Specifications 

Resolution 

2592  x  1944 

Diagonal  field  of  view 

50° 

Aperture 

3  mm 

Assumptions 

A 

550  nm  (green) 

Threshold  pixels  on  target 

32  x  32 
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Figure  12.  Side-by-side  results  for  visual  acquisition  (left)  and  target  recognition  (right). 


Inasmuch  as  the  effective  VBN  window  depends  critically  on  initial  conditions,  especially  QE, 
this  particular  instance  shows  the  target  does  not  come  into  view  until  a  range  of  about  430  m. 

To  be  recognized  at  this  distance,  the  target  must  have  a  minimum  dimension  of  about  4  m.  The 
last  opportunity  for  recognition  comes  at  about  250  m,  by  which  point  the  minimum  target 
dimension  has  dropped  to  2.5  m.  As  such,  these  numbers  might  prove  feasible;  however,  this 
assumes  onboard  processors  can  handle  the  5  Mpix  throughput  in  real  time/  In  fact,  this  turns 
out  to  be  a  dangerous  assumption,  as  feature  extraction  algorithms  typically  require  considerable 
computational  overhead. 

For  comparison,  Svab  et  al.  (2009)  report  an  implementation  of  the  Speeded-up  Robust  Features 
algorithm  on  a  Field  Programmable  Gate  Array  at  high-definition  (1024  x  768  pixels)  resolution 
achieving  10  fps  (frames  per  second).  At  this  resolution,  the  minimum  target  dimension  increases 
to  approximately  10  m  to  achieve  recognition  at  430  m. 


* 

To  meet  guidance  and  control  requirements,  a  tactical  VBN  solution  would  need  to  operate  at  approximately  10-20  fps 
(Malley,  2013). 
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The  preceding  example  serves  to  illustrate  some  of  the  performance  trade-offs  and  design 
challenges  that  must  be  addressed  to  enable  projectile  VBN.  It  seems  likely  that  a  successful 
implementation  of  projectile  VBN  will  require  larger  standoff  visual  acquisition  against  smaller 
targets.  Several  schemes  have  been  considered  toward  this  end,*  including  the  use  of  “view¬ 
steering,”  which  we  briefly  explore  in  the  next  section. 


7.  Conclusion  and  Future  Work 


In  this  study,  we  have  developed  a  model  for  visual  acquisition  for  a  strap-down  forward-facing 
imager  with  a  fixed  FOV.  We  hope  that  this  analysis,  together  with  other  models  being 
developed  for  machine  recognition,  can  be  used  to  optimize  design  parameters,  evaluate 
performance,  and  expose  operational  limitations  of  vision-based  projectile  navigation  systems.  A 
subsequent  analysis  will  investigate  the  physical  constraints  on  target  recognition  arising  from 
sensor  and  lens  characteristics,  as  well  as  atmospheric  effects  and  lighting  conditions. 

It  is  clear,  however,  that  there  must  always  be  a  fundamental  trade-off  between  FOV  (and  hence 
visual  acquisition)  and  resolution  (and  hence  recognition).  To  be  sure,  larger  pixel  arrays  can 
increase  resolution  somewhat,  but  the  increased  computational  burden  can  be  crippling  for  real¬ 
time  operation  on  a  low-cost  mobile  platform,  as  mentioned  previously.  This  constraint  derives 
from  the  necessity  to  search  the  full  FOV  to  initially  find  the  target.  In  fact,  it  may  be  possible  to 
leverage  onboard  sensor  information  (from  inertial  measurement  units,  magnetometers,  etc.)  and 
minimal  target  information  to  approximate  relative  target  position  in  body  coordinates  and 
further  narrow  the  search  region.  Coupled  with  a  view-steering  mechanism  (mechanical  or 
digital),  this  could  provide  a  powerful  VBN  technique  worth  further  consideration. 


* 

One  notable  approach  employs  scaled  templates.  A  single  high-resolution  template  is  continuously  updated  (resampled  and 
cropped)  to  correspond  to  the  smallest  recognizable  target.  Thus,  for  example,  the  algorithm  might  first  search  for  a  32-  x  32- 
pixel  city  block,  then  a  32-  x  32-pixel  house,  and  so  on. 
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Appendix  A.  Simulation  Results 
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A.l  Stationary  Target  (no  TLE) 
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A.2  Moving  Target  1  (no  preferred  heading) 

Target  location  error  is  introduced  with  respect  to  reported  position  and  speed.  In  this  scenario, 
target  heading  is  unknown  and  assumed  to  be  uniformly  distributed.  The  notation  is  defined  in 
table  4  of  the  main  text. 
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A.3  Moving  Target  2  (with  preferred  heading) 

In  this  scenario,  nominal  target  heading  is  reported.  Target  location  error  is  introduced  with 
respect  to  reported  position,  speed  and  heading.  Notation  is  defined  in  table  5  of  main  text. 


A.3.1  Median  Response 

The  left-hand  column  shows  results  without  TLE.  The  right-hand  column  shows  the  results  for 
the  corresponding  Monte  Carlo  simulations  with  TLE.  Only  the  median  response  is  shown. 
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A.3.2  Percentile  Distribution 

Performance  of  the  15th,  50th  (median),  and  85th  percentiles  are  plotted  (orange,  blue,  and  red, 
respectively)  for  each  combination  of  target  heading,  initial  projectile  velocity,  and  QE.  For 
comparison,  the  corresponding  “no-error”  a  histories  are  superimposed  (dashed  line). 
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Appendix  B.  Derivation  of  Ground  Resolution  for  a  Diffraction-Limited 

Pinhole  Camera  Model 


We  wish  to  define  the  resolution  as  the  differential  ratio  of  image  pixels  to  object  area  dp/dA0 
as  a  function  of  slant  range  and  angular  position  (figure  B-l).  The  object  area  is  taken  to  be  the 
target  profile  as  seen  from  the  imager. 


Figure  B-l.  Differential  object  and  image  areas  for  pinhole  camera  model  (left).  Relation  of  field  of  view  (FOV)  to 
focal  length  and  sensor  dimensions  (right). 


We  assume  a  pinhole  camera  model.  The  3-D  object  coordinates  { x ,  y,  z }  are  thus  mapped  to  the 
2-D  image  coordinates  {xt,  yt]  by  the  projection  transformation 


(B-l) 


where  /  is  the  focal  length.  Expressing  { x ,  y}  in  spherical  coordinates  yields 


/ Xj\  _  /cos0tan0\ 

lyj  —  ’  \sin  0  tan  9 ) 


(B-2) 


The  differential  image  area  is  then  (making  use  of  the  Jacobian  of  the  transformation) 

d(x,  y) 


dAi  = 


d(0,0) 


dddcp 


det  ^  J 


— /  cos  0  sec2  6  f  sin  0  tan  6 


/sec20sin0  — /cos0tan0> 


ddd(p 


(B-3) 


=  f2  |sec2  9  tan  6  \  dGd(p 


The  differential  object  area  cL40for  a  spherical  shell  of  constant  radius  r  is  r2  sin  9  d9d<p.  The 
resolution  can  now  be  expressed. 
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Res  = 


dp 

dA0 


dp  \  dAt 
dAj  dA0 


VhVw  f2 sec2 d  tan  0  dO dcp 
hw  r2  sin  6  dOdtp 

PhPw  /2sec36> 
hw  r2 


(B-4) 


where  { ph ,  pw }  are  the  height  and  width  of  the  sensor  array  in  pixels,  respectively.  Referring  to 
figure  B-l,  we  can  express  /  as  a  function  of  FOV: 


f  1  V/i2  +  w2 
f  ~  2tan(F0R/2) 


In  terms  of  the  FOV,  the  resolution  is  then 


Res  = 


VhVjy  +  w2) 

4  hwr2 


(B-6) 


The  resolution  is  not  uniform  over  the  imager  but  rather  increases  as  sec3  0.  Therefore,  as  the 
FOV  increases,  we  can  expect  more  pronounced  border  distortion*  (figure  B-2).  With  proper 
calibration,  this  effect,  as  well  as  other  optical  distortions  causing  radial  and  tangential  image 
deformations,  can  be  largely  rectified  in  software.1" 


*For  the  pinhole  camera  model  under  consideration,  this  is  characterized  by  so-called  pincushion  distortion,  depicted  in 
figure  B-2.  Lenses  may  exhibit  various  forms  of  radial  distortion.  A  notable  example  is  the  fish-eye  lens,  which  is  characterized 
by  decreasing  border  resolution. 

^Several  such  camera- calibration  and  image  post-processing  packages  exist,  including  open  source  codes,  such  as  Gustavsson 
(2010).  Proper  calibration  is  particularly  important  for  this  application  given  the  real-time  and  low-cost  mission  requirements. 
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sec30 


Figure  B-2.  Resolution  is  proportional  to  the  cube  of  the  secant  of  the  angular  displacement  from  the  optical  axis 
(left).  Equal  areas  exhibit  pincushion  distortion  under  transformation  (right). 


For  a  target  profile  with  area  d2,  the  number  of  pixels  on  the  target  is  (d2  X  Res).  Requiring 
Vmin  pixels  on  the  target  and  solving  for  d,  we  can  express  the  minimum  target  dimension  as  a 
function  of  slant  range: 


drn  in 


2VF^pm,„  tan^(cos9)3'2  r 
VPftPw  (/l2  +  W2) 


(B-7) 


For  a  square  focal  array  with  pw  x  pw  pixels,  equation  B-7  reduces  to 


di  > )  /  a 


a/2  Pmin  tan (cos  0)3/2r 
Pw 


As  an  example,  consider  an  imager  with  a  1024-  x  1024-pixel  array.  The  dimension  of  the 
smallest  resolvable  target  is  plotted  as  a  function  of  slant  range  for  selected  FOYs  (figure  B-3). 
Although  increased  off-axis  resolution  theoretically  allows  for  smaller  target  recognition,  these 
gains  are  somewhat  offset  by  increased  radial  aberration. 
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Figure  B-3.  Minimum  resolvable  target  dimension  for  a  specified  FOV  and  slant  range  (left).  Increased  off  axis 
resolution  allows  for  smaller  target  recognition  (right). 
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